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The total entropy production fluctuations are studied in some exactly solvable models. For these 
systems, the detailed fluctuation theorem holds even in the transient state, provided initially the 
system is prepared in thermal equilibrium. The nature of entropy production during the relaxation 
of a system to equilibrium is analyzed. The averaged entropy production over a finite time interval 
gives a higher bound for the average work performed on the system than that obtained from the well 
known Jarzynski equality. Moreover, the average entropy production as a quantifier for information 
theoretic nature of irreversibility for finite time nonequilibrium processes is discussed. 
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I. INTRODUCTION 

Nonequilibrium thermodynamics of small systems has 
attracted much interest in recent years [1]. In these sys- 
tems, thermal fluctuations are relevant and probability 
distributions of physical quantities like work, heat and 
entropy replace the sharp values of their macroscopic 
counterparts. In this context, fluctuation theorems (FTs) 
[2-16] provide exact equalities valid in a system driven 
out of equilibrium, independent of the nature of driving. 
One of the fundamental laws of physics, the second law 
of thermodynamics, states that the entropy of an isolated 
system always increases. The second law being statisti- 
cal in nature does not rule out occasional excursions from 
the typical behaviour. FTs make quantitative predictions 
for observing events that violate the second law within a 
short time for small systems by comparing the probabili- 
ties of entropy generating trajectories to those of entropy 
annihilating trajectories. FTs play an important role in 
allowing us to obtain results generalizing Onsager Reci- 
procity relations to the nonlinear response coefhcients in 
nonequilibrium state. 

Entropy or entropy production is generally considered 
as an ensemble property. However, Seifert [15, 16] has 
generalized the concept of entropy to a single stochastic 
trajectory. The total entropy production along a single 
trajectory involves both the particle entropy and the en- 
tropy change in the environment. It is shown to obey the 
integral fluctuation theorem (IFT) for any initial condi- 
tion and drive, over an arbitrary finite time interval, i.e., 
transient case. In [15, 16], it is also shown that in the 
nonequilibrium steady state over a finite time interval, a 
stronger fluctuation theorem, namely the detailed fluc- 
tuation theorem (DFT) holds. Note that originally DFT 
was found in simulations of two-dimensional sheared flu- 
ids [7] for entropy production in the medium in the steady 



state, but in the long-time limit. This was proved in 
various contexts, e.g. (i) using chaotic hypothesis by 
Gallavotti and Cohen [9], (ii) using stochastic dynam- 
ics by Kurchan [17] as well as by Lebowitz and Spohn 
[18], and (iii) for Hamiltonian systems by Jarzynski [19]. 

In our present work, we obtain the total entropy pro- 
duction (Astot) distribution function, P(Astot), for dif- 
ferent classes of solvable models. In particular, we con- 
sider (i) a Brownian particle in a harmonic trap subjected 
to an external time-dependent force, and (ii) a Brown- 
ian particle in a harmonic trap, the centre of which is 
dragged with an arbitrary time-dependent protocol. 

In these models, we show that the DFT is valid even 
in the transient case, provided the initial distribution 
of the state variable is a canonical one. If the initial 
distribution is other than canonical, DFT in transient 
case does not hold, as expected. To illustrate this, we 
have analyzed the total entropy production for a system 
initially prepared in nonequilibrium state which relaxes 
to equilibrium. Finally we briefly discuss the important 
consequences of entropy production fluctuation theorem, 
namely, (i) it gives a new bound for the average work 
done during a nonequilibrium process over a finite time, 
generalizing the earlier known concept of free energy to 
a time-dependent nonequilibrium state. This bound is 
shown to be higher than that obtained from the Jarzyn- 
ski equality; (ii) average total entropy production over 
a finite time quantifies irreversibility in an information 
theoretic framework via the concept of relative entropy. 
This is distinct from the recently studied measure [20- 
24]. 



II. THE MODEL 

Case I: A particle in a harmonic trap subjected 
to an external time-dependent force 
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We consider a Brownian particle in a harmonic poten- 
tial and in contact with a heat bath at temperature T. 
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The system is then subjected to a general driving force 
f{t). The potential is given by Vo{x) = ^kx^. The par- 
ticle dynamics is governed by the Langevin equation in 
the overdamped limit: 



jx = -kx + fit)+^it), 



(1) 



where 7 is the friction coefficient, k is the spring con- 
stant and ^ (t) is the Gaussian white noise with the prop- 
erties = and (C(t)C(t')> = 2r7(5(t - t'). The 
magnitude of the strength of white noise ensures that 
the system reaches equilibrium in the absence of time- 
dependent fields. 

Using the method of stochastic energetics (or the en- 
ergy balance) [25, 26], the values of physical quanti- 
ties such as injected work or thermodynamic work (W), 
change in internal energy (AC/) and heat (Q) dissipated 
to the bath can be calculated for a given stochastic tra- 
jectory x{t) over a finite time duration t: 



W 



= Jo = -[ ^(tVit'W, (2a) 



AU = U{x{t),t)-U{xo,0) = -kx''-xf{t)--kxl 

(2b) 



and 



Q = W-AU. 



(2c) 



Equation (2c) is a statement of the first law of ther- 
modynamics. The particle trajectory extends from initial 
time f = to final time t, xo in equation (2b) is the initial 
position of the particle. For simplicity, we have assumed 
that /(O) = 0. 

Initially the system is prepared in thermal equilibrium. 
The distribution function is given by 



P{xo) 



2itT 



exp 



2T 



(3) 



The Boltzmann constant ks has been absorbed in T. 
The evolved distribution function P{x,t), subjected to 
the initial condition P{xo), is obtained by solving the 
corresponding Fokker Planck equation, and is given by 



A ^ 



(6) 



The nonequilibrium entropy S of the system is defined 
as 



S{t) = - J dx P{x,t)\nP{x,t) = (sit)). 



(7) 



This leads to the definition of a trajectory dependent 
entropy of the particle as 



s{t) = -lnP{x{t),t), 



(8) 



The change in the system entropy for any trajectory of 
duration t is given by 



As 



In 



P{x,t) 



Pixo) 



(9) 



where P{xo) and P{x,t) are the probability densities of 
the particle positions at initial time t = and final time t 
respectively. Thus for a given trajectory x{t), the system 
entropy s{t) depends on the initial probability density 
and hence contains the information about the whole en- 
semble. The total entropy change over time duration t is 
given by 



Astot = Asm + As. 



(10) 



Using the above definition of total entropy production, 
Seifert [15, 16] has derived the IFT , i.e.. 



) = 1, 



(11) 



where angular brackets denote average over the statistical 
ensemble of realizations, or over the ensemble of finite 
time trajectories. 

In nonequilibrium steady state, where the system is 

characterized by timc-idependent stationary distribution, 
a stronger fluctuation theorem (DPT) valid over arbi- 
trary finite time interval holds [15, 16]. This theorem for 
the total entropy production can be stated as 



P{x,t) 



where 



k f k(x-{x)f 
exp 



27rr 



(x)^- [ e- 
7 Jo 



2T 



fc(t-t')/7J(i')^i'. 



(4) 



(5) 



A change in the medium entropy (As^) over a time in- 
terval is given by 



P{-Astot) 



(12) 



The above theorem holds even under more general situ- 
ation, i.e. when system is subjected to periodic driving: 
f{x, t) = f{x, T + Tp), where Tp is the period. The addi- 
tional requirement is that the system has to settle into a 
time-periodic state: P{x,t) = P{x,t + Tp), and trajec- 
tory length t is an integral multiple of Tp. 
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As a side remark, we would like to state that if the dis- 
tribution P{Astot) is a Gaussian and satisfies IFT, then 
it naturally satisfies DFT, even if system is in a transient 
state. This happens to be the case in our present prob- 
lem only under the condition that the system is being 
prepared initially in equilibrium, as shown below. 

Using (2c), (6), (8) and (10), the total entropy becomes 



W~AU , Pix,t) 
m ■ 



T 



Pixo) 



(13) 



Substituting for AU from equation (2b), and using (3) 
and (4), we get 



Astot = ^(w+h{x)^+xf~kx{x)], (14) 




The work is a linear functional of x{t), and from the 
above equation, we observe that Astot is linear in x, while 
X is itself a linear functional of Gaussian random variable 



xit)=xoe-'''/-' + - I e-'=(*-*''/^[/(t')+e(i')]'^^'- (15) 
7 Jo 

From the above fact it follows that P{Astot) is a Gaus- 
sian function. It is therefore sufficient to calculate the 
mcan((Astot)) and variance (cr^ = (As^q^) — (Astot)^) to 
get the distribution, which is of the form 



PiAstot) 
where 



V2^ 



exp 



{Astot - {Astot)y 
2a2 



(16) 



FIG. 1: (colour online) In the figure, we have plotted P{Astot) 
vs Astot for various observation times, when the initial dis- 
tribution is athermal (cr^ = 0.2). For thermal distribution, 
= 0.1. The observation times are t = 10 (solid line), 
t = 20 (dashed line), t = 50 (bigger dashed line) and t — 100 
(dotted line). The inset shows total entropy distributions for 
same observation time values, when the the initial distribu- 
tion is thermal. For this case, all distributions are Gaussian. 
For both cases, A = 0.1, k = 0.1 and lu = 0.1. 



To arrive at (19b), we have used the fact that (VF^) — 
(W)^ = 2T (^{W) + 4f^) which has been proved in ap- 
pendix A. Also in the same appendix, we have shown 
that the cross-correlation 



{Wx)-{W){x) = j[k{x{t))-f{t)]. (20) 



{Asto,) = ^(^{W)-h{xr + {x)f], (17) 
The formal expression of (IF) is given by 



(IF) = - / {x{t'))f{t') dt 
Jo 



(18) 



where (x) is given by (5). The variance cr^ is given by 



cr = — 



1 



{{Wx)~{W){x)){2f-2k{x)) (19a) 



= ^(2(IF) + ^ + fc(x)2-2(x)/ 



1 

T2 



{{Wx) -{W){x)){2f-2k{x)). 



(19b) 



Using equation (20) in (19b), it follows that 
a^ = 2{Astot). 



(21) 



The Gaussian distribution of P{Astot) along with the 
above obtained condition for variance implies validity of 
the detailed fluctuation theorem for general protocol f{t). 
Needless to say, this theorem in the considered linear 
system is valid even in the transient case provided the 
initial distribution for the state variable is a canonical 
distribution. Further, DFT also implies IFT (but the 
converse is not true). 



1. Special case: sinusoidal perturbation 

For this case, we consider f{t) to be a sinusoidal os- 
cillating drive, i.e., f{t) = As'mujt. Using equation (17), 
we obtain 



4 



(Astot) = 



1 
T 



(W) - -k{xf + A{x) sinut 



+8e~''*^'^ kjLU cos Lvt - 2kjujcos2Lut + {k^ - 7^w^) sin2wij 



(22) 



The variance is = 2(Astot)) and distribution 
P(Astot) is Gaussian as mentioned earlier. For this 
case, if the initial distribution is not canonical, then 
P(Astot) is not a Gaussian. This is shown in figure 1 
where we have plotted P{Astot) for the above protocol 
obtained numerically for various times as mentioned in 
the figure caption. The initial distribution is a Gaus- 
sian with P{xq) = y^^^rt^xp where the con- 
In 



dition cr^ ^ T represents an athermal distribution. 



the inset, we have plotted P{\stot) for same parameters 
used for the main figure for thermal initial distribution: 
— T — Q.l (for this case, distributions for Asjot are 
Gaussian). All quantities are in dimensionless units and 
values of physical parameters are mentioned in figure cap- 
tion. We clearly notice that the distributions P{/S.stot) 
in the main figure are non-Gaussian. The observed val- 
ues of (e~^**°*) from our simulation equal 1.005, 1.006, 
0.995 and 1.011 for t = 10,20,50 and 100 respectively 
in the athermal case. All these values are close to unity 
within our numerical accuracy, clearly validating IFT. 
For numerical simulations, we have used Heun's scheme. 
This gives a global error in the dynamics of the order of 
/i^, where h is the time step taken in the simulation (for 
details, refer to [27]). To minimize the error in calculat- 
ing (e~'^*'°'), we have taken large number of realizations 
(more than 10''), depending on parameters. Our esti- 
mated error bars are found to be around 10~^. Moreover, 
these values act as a check on our numerical simulations 
[28-31]. As the observation time of trajectory increases, 
weight on the negative side of P{Astot) decreases, i.e., 
the number of trajectories for which Astot < decreases. 
This is expected as we go to macroscopic scale in time. 
The asymmetric distributions at short time scales tends 
closer to being a Gaussian distribution with non-zero pos- 
itive {As tot)- The central Gaussian region increases with 
the time of observation. The presence of non-Gaussian 
tails (large deviation functions associated with the proba- 
bility of extreme events) at large values of A,s/o/ becomes 
very difficult to detect numerically. However, they are 
not ruled out. For large times, cr^ « 2{Astot), suggesting 
validity of DFT only in the time asymptotic regime. Sim- 
ilar observations have been made in regard to work and 
heat distributions for a driven Brownian particle [28-32] . 

The Fourier transform of the distribution P{Astot) 

can be obtained analytically for a given initial athermal 
Gaussian distribution of the particle position in presence 



of a drive. This can be obtained following exactly the 
same procedure of Zon et al [12] for heat fluctuations. 
However, later we consider a simpler case of a system 
relaxing to equilibrium in absence of protocol (case III). 



B. Case II: P(Astot) for particle in a dragged 
hcirmonic oscillator 

For this case, the effective potential U{x,t) for the 
Brownian particle is given by 



uix,t) = ik[x-m)' 



(23) 



The centre of the harmonic oscillator is moved with a 
time-dependent protocol f{t)/k. The special case of this 
model is when f{t)/k = ut (centre of the oscillator is 
moved uniformly with velocity u). This model has been 
extensively studied both experimentally [33] and theo- 
retically [11, 12, 34-36] in regard to analysis of Jarzynski 
non-equilibrium work relation [10] and related issues. 
The expression for work is given by 



' ^(fjf(f)df + (24) 



By taking canonical initial condition for P{xq), given in 
equation (3), the probability density at time t is given by 



P{x,t) = 



2-kT 



exp 



k{x - {x)f 
2T 



(25) 



where 



{x) = - I e-'=(*-*')/T/(t')di'. (26) 
7 Jo 

The change in internal energy during a time t is 



Au=\kix-m 



k J 2"''° 



(27) 



For simplicity, we have set /(O) = 0. The expression for 
Astot reduces to 



5 



W 



T 2kT 



xl 
T 



k{x)^ kx{x) 



2T 



T 



(28) 



From equation (28), it follows that P{Astot) is a Gaus- 
sian. Carrying out exactly the similar analysis as before 

(i.e., for case I), after tedious but straightforward algebra, 
we finally obtain the expressions for mean and variance: 



{W) f k{x)^ , fix) 



2kT 



2T 



+ ■ 



(29) 



and 



2{W) 
T 



kT 



k{xf , 2f{x) 



T 



T 



= 2{Astot), (30) 



where {W) = J^{x{t'))f{t')dt', and (x) is given in equa- 
tion (26). The condition (30) along with P{Astot) being 
Gaussian implies validity of both DFT and IFT for As tot- 



1. Special case: The dragging force is linear 

We consider = ut, i.e., centre of the harmonic trap 

is being dragged uniformly with velocity u. To obtain 
P(As(ot), we need the expression for (Astot) only: 



[Astot) = -rrrrr I 1 



2kT 



(l - 6-*=*/^) (3 - e-'^*/'^) 



(31) 

The above expression can be shown to be positive for all 
times, as it must be. 



P{x,t) 



27r(x2) 



exp - 



2(a;2) 



(33) 



where {x'^{t)) is the variance in x at time t, which is equal 
to (x'^it)) = i + ^^e-2fet/7. The distribution P(.x,i) 
relaxes to equilibrium distribution as time t ^ 00. Using 
equation (13), (32) and (33), we get 



1 , 



2(x2) 2a2 



Now, considering the fact that AU = ^^(x^ — a;^), we 
arrive at 



k {al-T\ 2 1 fT 
Astot = -A-^)xl+- 



This can be written in a simplified form. 



Astot = ^axl + ^f3x'^ + K, 



2 



A;(a;2) 



(34) 



where a = k (^^f^y, (3 = ( '^t{1^) ^ ) and k = 

The total entropy production is a quadratic function of 
X and xo and hence P{Astot) is not Gaussian. To obtain 
P{Astot), we have to know the joint distribution of xo 
and X, namely P{xQ,x,t) which in our problem can be 
obtained readily and is given by 



C. Case III: Entropy production with athermal 
initial condition: a case study for a relaxation 
dynamics 

In this subsection, we study a system relaxing to- 
wards equilibrium. If initially the system is prepared 
in a nonequilibrium state, then in absence of any time- 
dependent perturbation or protocol, it will relax to a 
unique equilibrium state. The statistics of total entropy 
production is analyzed. Our system consists of a Brown- 
ian particle in a harmonic oscillator {Vo{x) = ^kx^) and 
the temperature of the surrounding medium is T. The 
initial distribution of the particle is taken to be 



P(x'c 



277(7? 



exp 



^ 1 



Note that when cr^ ^ T. it represents athermal initial dis- 
tribution. Since no protocol is being applied, the thermo- 
dynamic work done on the system is identically zero. As 
time progresses, the distribution evolves with probability 
density given by 



P{xo,x,t) = 



where 



1 



27r\/det A 



exp[(a-(a))^A-\(a-(a))] 

(35) 



a = 



Xo 

X 



(36) 



xq and X being respectively the initial and final positions 
of the particle. The matrix A is defined through 

A ^ ((a-(a)).(a-(a))t) = (a.at) 

\ / (Xq) (xXo) 

( Xo x)j-^ 



Xo 

X 



( 



V k 



{xxq) (a;2) 



-fet/7 



-fct/7 



-2fct/7 



(37) 



With the help of the distribution given in (35), one can 
write, using equation (34), 



dx dxQP{xo,x,t) 



X S 



.(38) 



The evaluation of P{Astot) is a diffi- 
cult task. However, the Fourier transform 

P{R,t)[= Je''^'^'^"^P{Astot)dAstot] of P{Astot) 
can be obtained easily. To this end we can carry out the 
analysis similar to that for heat distribution in a drivec 
harmonic oscillator by Zon et al [12]. Finally we get 



P{R,t) 



„iRK. 



y^det{I - iRA.B) 



(39) 



The details of this derivation are given in appendix B. 
Substituting i? = i in the above equation, and we get 
P(R = i,t) ^ (e"'^''*°*) = 1, consistent with the IFT (see 
appendix B for details). From equation (39), we also note 
that PiR.t) ^ P(i - R,t), indicating that DFT is not 
valid for this linear problem in the presence of athermal 
initial distribution. From above equation, we can also 
obtain average entropy production given by 



1 d ^ 
I oR 



R=0 



T 



2T 

im 



_ g-2fci/7 



r + e-2'=*/^((72 -T) 



(40) 



Similarly, higher moments can also be obtained with the 
use of this characteristic function. One can invert the 
characteristic function to obtain P{Astot) using integral 
tables. However, the expression is complicated and unil- 
luminating. From the Fourier transform, it is obvious 
that P{Astot) is non-Gaussian. 

In figure 2, we have plotted P{Astot) versus Astot over 
a fixed time interval (see figure caption) for two different 
cases for which initial width of the distribution cr^ equals 
0.05 and 0.2. The temperature of the bath is 0.1. The 
distribution P{Astot) in both cases are asymmetric. For 
the case = 0.2, the distribution is peaked around the 
negative value of Astot- However, it exhibits a long tail 
making sure that (Astot) is always positive. Since initial 
width of the distribution is larger than the thermal dis- 
tribution, change in the entropy of the system during the 
relaxation process is negative and it dominates the total 
entropy production. Hence we obtain peak in P{Astot) 
in the negative side of Astot- For the case tr^ — 0.05, 
change in the entropy of the system is positive. Hence 
peak in P(Astot) is in the positive region. In both cases, 
we obtain (e"^***"*) equal to unity within our numerical 
accuracy: 0.978 {al = 0.2) and 1.001 {al = 0.05), con- 
sistent with IFT. In the inset, we have plotted {Astot) 
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FIG. 2; (colour online) The figure shows plots of P{Astot) vs 
Astot during relaxation to equilibrium (external protocol is 
absent). The initial distributions are athermal with al = 0.05 
(solid line) and al — 0.2 (dashed line). The spring constant 
is fc = 0.1 and observation time was t — 40, by which the 
system has reached equilibrium (see inset). The inset shows 
plots average entropy versus observation time for the same 
initial distributions. 



as a function of time for the above cases. (Astot) is a 
monotonically increasing function of time and saturates 
asymptotically when equilibrium is reached. It may be 
noted that equilibrium is characterized by zero total en- 
tropy production, change in the entropy of bath at any 
instant being compensated by equal and opposite change 
in entropy of the system. 



III. SOME RELATIONS RESULTING FROM 
THE AVERAGE ENTROPY PRODUCTION 
FLUCTUATIONS OVER FINITE TIME 

We now discuss some related offshoots of the total en- 
tropy production. These give a higher bound for the 
average work done over a finite time and provide a dif- 
ferent quantifier for the footprints of irreversibility. The 
Jarzynski non-equilibrium work relation [10] relates work 
done over a finite time in a non-equilibrium state to the 
equilibrium free energy differences, namely. 



(41) 



Here the angular brackets denote an average over a statis- 
tical ensemble of realizations of a given thermodynamic 
process. The finite time thermodynamic process involves 
changing the time dependent parameter X{t) of the sys- 
tem from initial value A(0) — Ato a. final value A(r) — B. 
\{t) can be an arbitrary function of time. Initially the 
system is prepared in equilibrium state corresponding to 
parameter A, and work W is evaluated over a time r. 
At the end of the period r, the system in general will 



not be at equilibrium corresponding to parameter B, yet 
from this non-equilibrium work, one can determine the 
difference in equilibrium free energies, AF, between the 
states described by A and B, using equation (41). From 
the same equation, using Jensen's inequality, it follows 
that 

(W) > AF = Fb - Fa- (42) 

This result is consistent with the Clausius inequality, 
which is written in the form of work and energy, instead 
of the usual heat and entropy. Using Jensen's inequality 
and the integral fluctuation theorem of entropy produc- 
tion, namely equation (11), it follows that the average 
total entropy production over a time t, (Astot) > 0. Us- 
ing equation (2c), this can be rewritten as 

(Astot) = ^{W-AU+TAs) > ^ (W^) > {AU-TAs), 

(43) 

where AU and As are the changes in internal energy and 
in system entropy respectively. The time-dependent free 
energy in a nonequilibrium state can be defined as [37]: 

F{x,t) = U{x,t)-Ts{x,t) = U{x,t)+T\nP{x,t), (44) 

which is in general a fluctuating quantity. Since free 
energy depends on entropy, it contains the information 
of the whole ensemble. In equilibrium, the expectation 
value of this free energy reduces to the Helmholtz free 
energy. Using (43) and the given definition of nonequi- 
librium free energy described above, it follows that 

{W) > {AFir)), (45) 

where AF{t) = F2{t) - Fi(0). 

If initially the system is prepared in equilibrium with 
parameter A, Fi equals equilibrium free energy F^- 
F2{t) is determined by the probability distribution at 
the end point of the protocol at which the system is 
out of equilibrium with system parameter at A = i?, i.e. 
F2{t) = U{x,t) + T\nP{x,T). Now in the following, we 
show that 

{AF{t)) >AF^Fb- Fa, (46) 

thus giving a higher bound for the average work done 
over a finite time. To this end, consider a situation at 
which initially the system is prepared in equilibrium with 
parameter \ = A (corresponding to free energy Fa) and 
is allowed to evolve with the time-dependent protocol 
\{t) up to time r at which X = B. Beyond r, the system 
is allowed to relax to equilibrium by keeping A fixed at 
B. At the end of the entire process, the total change in 
equilibrium free energy equals Fb — Fa ■ The free energy 
being a state function, one can rewrite it as 




A 



FIG. 3: (colour online) Plots for AF, (AF(r)) and {W) as 
functions of the driving amplitude A, with the parameter val- 
ues set at a; = 0.2, k = 0.1 and r = n/2uj. 



Fb-Fa = {Fb ~ F2{t) + F2{t) - Fa) 

- Fb- (F2(r)) + (AF(r)). (47) 

Here, {AF{t)) is the average change in the nonequilib- 
rium free energy, (F2(r)) — Fa, during the process up to 
time T whereas Fb — {F2{t)) is the change in the free 
energy during the relaxation period when the protocol 
is held fixed. One can readily show that [37] during the 
relaxation process towards equilibrium, the average (or 
expectation value) of free energy always decreases, i.e., 
{Fb — F2{t)) is negative. From this and equation (47), it 
follows that {AF{t)) > Fb — Fa- Thus we get a higher 
bound for the average work done than that obtained from 
the Jarzynski identity [10]. 

To illustrate this, in figure 3 we have plotted {W), 
{AF{t)) and AF for a driven harmonic oscillator U (x) = 
^kx^ with force f{t) — A sin cut as a function of the am- 
plitude of driving A. For this graph, system parame- 
ter f{t) changes from /(O) = to /(r) = A (AF = 

Fb — Fa — -^), i-e., for a time variation from t = to 
t — T = We observe from the figure that {AF{t)) 
is indeed a higher bound. The analytical results for this 
model are presented in appendix C. 

Some remarks, however, are in order. The realizations 
for which W < AF need not correspond to Astot < 0, 
and vice versa. This implies that the trajectories which 
violate the second law, namely Astot < 0, do not nec- 
essarily violate the inequality W < AF, which is also 
closely related to the second law [38] . Equation (45) can 
be treated as a generalization of Clausius' inequality to 
nonequilibrium processes. 

Dissipation is related to our ability to distinguish the 
arrow of time. Hence the dissipated work {Wd) = 
{W) — AF is recently identified as the measure of ir- 
reversibility. Moreover, it turns out that the relative en- 
tropy of microscopic trajectories Di{P\\P) in full path 
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space between forward (P) and reverse (P) processes is 
indeed equal to dissipative worlc, 

(W^) = D^iP\\P). (48) 

Hence £'i(P||P) works as a measure of irreversibility or 
indistinguishability between forward and backward evo- 
lutions. Here, forward evolution corresponds to the sys- 
tem being prepared initially at equilibrium in the state 
with control parameter A(0) = A evolved up to time r 
at which the control parameter is A(t) = B. During 
the backward evolution, the system is prepared in equi- 
librium with control parameter B and the time-reversed 
protocol is applied from B to A. For details, see [20-23]. 
Separately, it can also be shown by using Crooks identity 
[21, 39]. 

{Wd) = D{P{W)\\P{-W)) (49) 
I 



where P[a:T-|xo] and P[a;^|a;o] are the shorthand notations 
for the probabilities of traversing the entire forward path 
from t = tot = T described by x{t) and that of travers- 
ing the reverse path described by variables x{t — t). For 
details, see references [14-16]. Here, the forward evolu- 
tion corresponds to the system being prepared initially in 
any arbitrary state and evolved up to time t along a pre- 
scribed protocol. At the end of the protocol, the system is 
in a state P{x, t) determined by the initial condition and 
the dynamics. During the backward process, the system 
is assumed to be in the same state corresponding to the 
end point of forward evolution P{x, r) = P(.to) and pro- 
toc;oI is timc-rcvcrsod, thereby evolving the system along 
the backward trajectory. Unlike for work (equation (49)), 
there is no Crooks'-like identity for the total entropy pro- 
duction between forward and reverse process (except in 
the stationary state). Hence it is not possible to describe 
the measure of irreversibility or dissipation in terms of 
the relative entropy between probability distribution of 
Astot for forward and backward processes. Thus, the 
information of irreversibility is contained in all the mi- 
croscopic variables associated with the system. This can 
also be noticed from the fact that the definition of total 
entropy produc;tion. involves the probability density of all 
the system variables. Moreover, this probability density 
contains the information about the initial and final en- 
sembles of the system variables. Identification of (Asjot) 
as a measure of irreversibility, is tantamount to identi- 
fying average dissipative work over a finite time process 



Here D{P{W)\\P{—W)) is the relative entropy between 
the two probability distributions P(W) and P{~W) 
which are the work distributions for the same thermody- 
namic process for forward and backward evolutions re- 
spectively. This brings us to an important conclusion 
that dissipation can be revealed by any finite set of vari- 
ables which contain information about the work or from 
the dynamics of those variables which couple to the con- 
trol parameter A. Thus one can identify few dynamical 
variables in which traces of the dissipation reside. This is 
unlike D{P\\P), which requires information about entire 
set of microscopic system variables during their evolu- 
tion. 



We note that (Astot) can be taken as the measure of 
irreversibility as it also represents the relative probability 
P'2(-P||^^) between forward and time-reversed backward 
protocols [14-16]: 



(50) 

I 

(W — AF{t)) = {Wdir)) as a measure of irreversibility, 
where (AP(r)) is the nonequilibrium change in average 
free energy over a finite time as mentioned before. Need- 
less to say, for this measure (Wd(r)), the system need not 
be in equilibrium at the beginning of the forward process 
which is a necessary condition for earlier defined mea- 
sure for irreversibility [20-23]. Further work along this 
direction is in progress. 



IV. CONCLUSIONS 

In conclusion, we have shown that in a class of solv- 
able linear models, Astot satisfies DFT even in the tran- 
sient regime provided the system is initially prepared in 
an equilibrium state. For athermal initial condition, the 
nature of total entropy production is analyzed during a 
relaxation process. The bound on average entropy pro- 
duction over a finite time process leads to a higher bound 
for the average work done over the same finite time inter- 
val. Some points have been raised if one assigns meaning 
to the average entropy production as a measure of ir- 
reversibility. This measure implies the generalization of 
Clausius' statement to nonequilibrium finite time pro- 
cesses, namely (^^(t)) = {W — AF{t)) > 0. Analysis of 
the total entropy production in presence of magnetic field 
is carried out separately. The results will be published 
elsewhere [40]. 



{Astot) = D2iP\\P) = / Pixo)P[xr\xo]\n K(^")^[^^l^o] ) dxo dx. 

J \ P{Xo)P[Xr\Xo\ J 
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APPENDIX A: CALCULATION OF VARIANCE 
OF AStot 



Calculation of variance of W: 



Using equation (2a), 



W-{W) = - f\x{t') - {x{t')))f{t')dt' 
Jo 

= - f dt'fit') x(t')e-*'*'/^ + e-'=*'/7 /■* e^'"'^^{t")dt" 
Jo Jo 



(^W - {W)f) = (xo)^ / dt'f{t')e-''''h / dtj{h)e-^'^h 
Jo Jo 
rt rt rt' 



\ [ dt'f{t')e-''*'/^ [ rfti/(ti)e-'=*i/^ / di"e'=*"/^ / ' dt2e^'^'^ {^{t")^{h 
1 Jo Jo Jo Jo 

f dt'f{t')e-''''l'^ f dt^f{ti)e-^'^h 
Jo Jo 



1 

k 



)) 



7 Jo Jo Jo 

= ^J^ dhfih)e-''*^/'< dt'f{t')e''''/'< 



The above integration, when integrated partiaUy gives 



K Jo 1 Jo Jo 



Noting that {x{ti)) = j^' e''*' 1^' f{t')dt' and 2. 



Calculation of cross correlation {Wx) — {W){x): 



W = - J {x{ti))f{ti)dti, we finally get 



{{W-{W)f) 



= 2T 



{W) + 



2k 



We have, from (2a) and (15), 
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{W{t)){xit)) 



On the other hand, 



{x{t'))f{t')dt 

ct' 



X {x{t)} 



j^i^j^ e-^(*'-*")/T/(i")rft" j f{t')dt' X ^ e-'=(*-*^)/T/(ti)rfti 

= _J_ fdt'fit') f dt"e-'=(*'-*")/V(i") f dhe-^^'-'^yyih). 
7 Jo io io 



(Al) 



W.x 



x{t')f{t')dt'] x{t) 



.xoe-'=*'/7 + 



7 i* + ^{t"))dt''^ f{t')dt' 

+ - /' e-'=(*-*i)/^(/(ti) + 
7 Jo 



.-. (W.x) 



-k(t-ti)h 



{xl)e-''^'+''^'y{t')dt' 

\ fdt'fit') f dt"e-'^^''-'")h rdt,[f{t")m) + m")ah))]e 
7 Jo Jo Jo 

I. f e-^i^+^')hf{t')dt' 
1^ Jo 

\ fdt'fit') f (it"e-'=(*'-*")/^ f dh[f{t")fih)+2Tj6it-t')]e-''^'-''^/\ 
7 Jo Jo Jo 



(A2) 



I 

where wc have used the fact that ^k{xo)'^ = ^T, and 

= 2T5(t - t'). Also, xo and ^(t) are uncorre- t 

lated. (VF(i)x(t))-(H^(0)(x(t)) =--e-'=*/W dt' j{t')e'''' dt' . 

Jo 

From (Al) and (A2), (A4) 

On integrating by parts, the integral on the RHS be- 
comes 



{W{t)x{t)) - {W{t)){x{t)) 

= -{T/k) [ e-'=(*+*')/T/(t')dt' 
Jo 



^0 7 



-(2T/7) fdt'f{t') f 
Jo Jo 

-{T/k)e-^''^ f 
Jo 



-k(t'-t")/y^-k{t-t")/i^^ii 



-^'''^f{t')dt' 



-(2T/7)e-'=*/T / dt'f{t')e-'''''^ [ e^^'" dt'{A2) 
Jo Jo 



= e^"y{t)-- r e''*'/y{t')dt'. 

7 Jo 

Using this, equation (A4) reduces to 



{Wit)x{t)) {W{t)){x{t)) = ^[k{xit)) - fit)]. (A5) 
Finally, from (A5) and (19b), we get 



Finally, one obtains 



= -[2{W) - k{xf + 2{x)f] = 2(Astot). (A6) 
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APPENDIX B: CALCULATION OF THE 
FOURIER TRANSFORM OF P{Astot,t) 



/OO 
-OO 

dx dxoP{xo,x,t)ex.p 



Let us consider the potential 



U{x,t) = -kx^ - xf{T), 



(CI) 



= e 



OO 



iR ( ^Xq + ^x^ + K 



where f(t) is an arbitrary protocol. The protocol 
X{t) = f{t) is assumed to be equal to zero at time t = Q. 
Thus, A(0) = 0. After time r, A(r) = /(r). The equilib- 
rium free energy at parameter corresponding to t = 0, is 



J — c 



dx dxoP{xo, x, t) exp 



fa 2 /3 2M = Tin ( y' • The equilibrium free energy corre- 

V 2 2 / J sponding to the final value of the protocol is 



(Bl) 



The factor exp 
ten as 



iR Xq + in (Bl) can be writ- 



exp 



iR ( + 



iiKat.B.a 



(B2) 



with 



.P{R,t) 



B 



a 
0/3/- 



da e 2 



(B3) 



ia+.A~^.a+i-Sat.B.a 



-00 

ARk /■OO 



27r\/det A , 

J— ( 

10 

g-iat.A-^(I-iiJA.B).a 



27rVdetA 

e 



00 

iiift; /-OO 



27rVdet A 



27r\/det A ^det(A-i) det(I - iRAM) 

„iRK 

= =. (B4) 

Vdet(I - iiJA.B) 

which is equation (39). 

The determinant det(I — zi?A.B) is given by 



det(7 - ii?A.B 

'al-T 



T-iR{al-T) 



+ 



/C(x2) 



k{x^) 



-2fct/7 _ ^ 



(B5) 



APPENDIX C: PROOF OF (AF(t)) > AF FOR 
HARMONIC OSCILLATOR 

In this appendix, our motivation is to evaluate 
{AF{t)) and show that {AF{t)) > AF. 



Tin 



27rT 



2k' 



(C2) 



Here, 



Fa = - — ■ 

^ 2k 



AF = Fb-Fa = -'—. (C3) 
The initial probability density of the particle position 



is 



P(xo) = 



k 



■ exp 



-kxl 



2nT ' V 2T 
The final time-evolved solution for P{x, r) is 



(C4) 



P{x,t) = 



k {-k{x-{x)f 
exp ' 



27rT 



2T 



(C5) 



where (x(t)) is obtained from equation (5) on replacing 
t by T. Thus, 



{AF{t)) -AF = \k{x^) - {x)f - I + ^ 

= ^^((x)^-2(x){ + g 

When f{t) ~ Asmujt, the instantaneous change in free 
energy is given by 



1 



AF{t) = -k{x{t)Y - {x{t))f{t) 



2(A;2 -h 72^2)2 



70; -h e*'*/''' (—70; cos ujt + k sin wt) 



70; + e''*/''' (— 7W cos -|- fc sin u)t) 



(C7) 
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and change in equilibrium free energy is given by For a protocol of time interval between t = to t = 

T = 2tt/u!, we get 

AF=^^^. (C8) 

I 



+ (2 - e-'='^/T"^) k^^w^ + 2e-*=^/2T"^73a;31 
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